Tag

#AI inference

6 articles

I've tested every MacBook Air in recent years - here's why the time to upgrade is now

This explainer explores how the MacBook Air M5 chip's advanced neural engine architecture enables powerful on-device AI processing, fundamentally changing how we think about edge computing and mobile artificial intelligence.

Mar 2713

Google Introduces TurboQuant: A New Compression Algorithm that Reduces LLM Key-Value Cache Memory by 6x and Delivers Up to 8x Speedup, All with Zero Accuracy Loss

Google introduces TurboQuant, a new compression algorithm that reduces LLM key-value cache memory by 6x and delivers up to 8x speedup without accuracy loss.

Mar 2428

tech

NeuReality taps former Google AI director to steer its inference operating system into the market

Israeli AI startup NeuReality has appointed former Google AI director Shalini Agarwal to guide its NR-NEXUS inference operating system into the market.

Mar 2426

Paged Attention in Large Language Models LLMs

Paged Attention emerges as a key solution to the GPU memory bottleneck in large language models, enabling more efficient memory usage and higher concurrency in AI inference systems.

Mar 2425

Arm’s first CPU ever will plug into Meta’s AI datacenters later this year

Learn what AI inference chips are, how they work, and why they're crucial for making AI systems faster and more efficient. This explainer explains the basics of inference chips using simple analogies.

Mar 2419

Startup Gimlet Labs is solving the AI inference bottleneck in a surprisingly elegant way

Gimlet Labs raises $80 million Series A to solve AI inference bottlenecks across multiple chip architectures including NVIDIA, AMD, and Intel.

Mar 2330